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This study investigated the extent to which the Instruc- 
tional Systems Development (ISD) process for task selection 
is being used to determine tasks that are trained at Radioman 
@eteeme OChool. Data Correlation Sheets containing the 
criteria ratings by the subject matter experts for all general 
radioman tasks formed the data base. The data were evaluated 
Pate ewalScriminant analysis, correlation analysis, and factor 
analysis contained in the Statistical Package for the Social 
Sciences. The results indicated that the number of selection 
criteria can be greatly reduced and still yield proper classi- 
fication of the tasks. Although the ISD process is doing an 
adequate job of task selection for the school, this research 
discovered that a proper combination of fewer criteria may 


improve the efficiency and effectiveness of the process. 
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INEROOUUCTION 


Importance of Entry-Level Training for Radiomen 


The focus of this thesis was directed specifically 
toward radioman training due to the unique character and 
criticality of the rating. Because of the continuous advance- 
ments and improvements in the telecommunications industry, 
the training of the operators must be constantly scrutinized 
and evaluated to keep abreast with technology. 

Over the last decade the Navy has witnessed its tele- 
communications expand from use of only the high frequency 
portion of the spectrum for long haul communications to 
its current use of the ultra and super high frequency ranges 
for the same type of communications through the employment 
of satellite communications systems, encryption devices, 
decryption devices, and other equipments all designed to 
produce more rapid and efficient communications. | 

To operate and maintain the complex array of tele-. 
communications equipment in the Navy's inventory, the human 
factor of the equation must not be ignored. Training of 
radiomen, especially at the entry-level phase, should pre- 
pare the student to meet the challenge with appropriate 
understanding and the necessary level of skills to accomplish 
tasks expected of his or her skill level. Poorly or in- 
adequately trained radiomen sent to their respective assign- 
ments would only lead to an inefficiency within the overall 


system. It is imperative, therefore, that radiomen receive 
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the proper amounts of training prior to reporting for duty 
and that the tasks selected for that training be appropriate 
for the job. 

Early in a radioman's career, assignments may be expected 
to naval telecommunications centers or naval communications 
stations ashore or to any of various ship types at sea. On 
the average, of the students graduating from Radioman Class 
A School, 40% are assigned to shore installations while the 


iL ; 
Duties ashore are 


remaining 60% are assigned to sea duty. 
Drimarily concerned with sending, receiving, and processing 
message traffic, whereas duties at sea range from the set up 
and operation of radioteletype circuits with appropriate 
cryptographic equipment, to publication corrections and 
message distribution (Radioman 3 & 2, 1978). In times of 
emergency or increases of threat in the environment, the 


radioman must be able to act quickly and effectively in 


establishing and maintaining point-to-point communications. 


Moeecrine for Domectine lLasks for Training 


Some tasks associated with a rating are rarely per- 
formed and if neglected would cause little or no job degrada- 
tion, while the criticality of adequate performance on other 
tasks makes training for them essential. Budgetary and time 


constraints, however, impose certain restrictions which make 





Indicated during personal communications with RMC Hendricks 
of Radioman Class A School in December, 1979. 
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necessary the decision as to which tasks get chosen for 
training and which do not. Thus, a selection process must 

be utilized. The purpose of this selection process should 

be to ensure that the important tasks will receive instruc- 
tion and to avoid wasting instructional resources on unimpor- 
tant tasks (CNET, 1978). 

Selection of training tasks in the Navy is done by a 
process called Instructional Systems Development (ISD). This 
is a systematic set of procedures for completely designing 
instructional programs. The full process includes five 
major phases: analysis, design, development, implementation, 
and control. The selection step falls under the analysis 
phase and contains specific tools and criteria for making 
selection decisions. In addition, the ISD process also deter- 
mines the appropriate instructional setting for those tasks 
selected for training. Class A School is delegated those 
tasks appropriate to vestibule training, Class C School is 
reserved for tasks in which advanced level training is more 
appropriate, and on-the-job training is designated for those 


tasks for which no formal schooling is deemed necessary. 


Research Objectives 


Radioman Class A School has recently come under criticism 
for alledgedly producing graduates who do not possess the 
basic knowledge and skills needed to operate standard communi- 
cations systems or function adequately in the communications 


environment (COMNAVAIRPAC, 1979). This leads to an important 
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question: How influential are the task selection criteria 
for selection of tasks for vestibule training in the case 
of Radioman Class A School? 
To answer the question of task selection effectiveness, 
specific research objectives were created: 
1. To what extent do prescribed ISD procedures for 
task selection actually determine the tasks that are trained? 
2. How do decision-makers actually use the ISD selec- 
tion criteria for decision making? 
3. Can the ISD decision criteria be used more effectively 


mereserecting tasks for training? 
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ISD PROCEDURES FOR TASK SELECTION 


ask Description 


For a greater appreciation of task evaluation and 
selection, the reader should be familiar with the official 
criteria for the identification of job tasks (CNET, 1976): 

Task Definition 

A task is the lowest level of behavior in a job that 
describes the performance of a meaningful function of the 
job. 

Mask Characteristics 

1. A task statement is a statement of a highly 

Specific action. 

2. A task has a definite beginning and end. 

3. Tasks are performed in relatively short periods 

of time. 

4. Tasks must be observable, 

>. A task must be measurable. 

6. Each task is independent of other tasks (performed 

for its own sake). 
selection Criteria 

Prior to the actual task selection process, a job task 
inventory (JTI) is composed through studies and surveys in 
the field. For radioman training, the JTI identifies general 
radioman tasks, that is tasks which do not require any special 
NECs. Once these tasks are compiled, the lists are submitted 
to groups of Subject Matter Experts (SME) for rating and 


evaluation. 
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The ratings are recorded on Data Correlation Sheets. 
Each sheet has several columns for the criteria which are 
rated on a scale from 1 to 5. Generally speaking, the higher 
the rating (i.e., the closer to 5) the higher the priority 
fPemetrarning. The following criteria are utilized as an aid 
in selecting tasks for training and are listed with their 
respective codes: 
Buewabiie Consequence of inadequate Performance. This 
is a measure of the effect a job may have on the mission 
if it is unsatisfactorily performed. 
1. Negligible 
ye Rather trivial 
3. Fairly serious 
4. Very serious 
o Disastrous 
Portmuemengance. this 1S @ measure of how much delay 
may be tolerated between the time the need for task performance 
arises and the time actual performance must begin. 
1. Extremely high (Performance may be delayed for a 


considerable period) 


Pee dole 
3. Average 
4. Low 


o. Extremely Low (Task requires immediate performance) 


io 





fT err eClub eet oeandLcates the effort, time 


and assistance needed by a student to acquire proficiency in 


the performance of the task. 


i, 
Za. 
3. 
4. 


a, 


Extremely low (No training is required) 
Low 

Average 

High 


Extremely high (Training is essential) 


Probability of Deficient Performance. This is the 


likelihood that the job performer will perform the task 


imisactisiactorily. 
l. Rarely, if ever. 
2. Less often than other tasks. 
3. About as often as other tasks. 
4. More often than other tasks. 
1 Oo. Very often. 


timer between JObeEintry and Task Performance. This is 


the lapse of time that occurs between the time the person 


reports for duty in a job and the time he or she actually 


carries out the particular task. 


1a 


ae 


Task not yet performed. 

Task first performed beyond four years after 
assignment. 

Task first performed between two and four years 
after assignment. 

Task first performed between one and two years 


after assignment. 
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2 


Task first performed during first year after 


assignment. 


Decay Rate. This is an estimate of the length of 


time a student is able to retain knowledge and skills learned. 


ies 


732 


Extremely high (Knowledge is rapidly lost) 

elke 

Average 

Low 

Extremely low (Knowledge is retained for a long 


period) 


womuuexicy. | this is a measure of how complicated 


the task is to perform. 


Ae 
Ze 
Se 
4. 


5. 


Extremely low (Simple) 
Low 

Average 

High 


Extremely high (Complex) 


Pac cRlenicy of Performance. This is a measure of the 


expected rate at which the task is likely to be performed. 


i: 
ie 


oi 


Never performed. 

Performed less than once per month. 

Performed at least once per month but less than 
twice per week. 

Performed twice per week. 


Performed more than twice per week. (Daily) 


ey 








eeeyect Matter Expert Evaluation Period 


Prior to selection of the tasks included in the current 
course at Radioman Class A School, Subject Matter Experts 
from the school evaluated all the tasks of the JTI on the 
Data Correlation Sheets. The evaluation occurred over a 
three-month period from August 1976 to 1 November 1976. 
Once each week the SMEs gathered and, aS a group, rated 
tasks on each of the criteria. Of the total group of 17 
SMEs, only five at any time would rate any given sage. = 

After rating the tasks on the criteria, the SMEs were 
asked to recommend the appropriate training facility: "A" 
memoon, “C'' School, Fleet Training or Functional School, 
formal on-the-job-training, or no formal training. The 
SMEs did not actually select tasks for training, they only 
recommended the instructional setting (Kennedy, Kalivoda, 


Dickie, Drummer, and Duember, 1978). 


Selection Judgment 


The ratings assigned to the task criteria were based 
upon the SMES' experience and judgment. Although the SMEs 
did not actually select the tasks to be trained, using the 
results of their task criteria ratings they did make 


recommendations regarding such task selection. 


44s indicated in personal communications with Mr. Richard 
Lund, the Front End Analysis Project Manager at the time, 
22 February 1980. 
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The selection of tasks for training is a judgment which 
requires: 

--A clear understanding of the duties, tasks, and 
elements that make up the job. 

--Analysis of collected data by individuals who are 
meh tar with the job. 

--An understanding of the resources and the respon- 
sibility of the command that makes the training choice. 

-—-A clear understanding of when and under what condi- 


im@emce training is appropriate. (CNET, 1978, p. 11). 


The Data Correlation Sheet 

The Data Correlation Sheets derive their tasks from 
those listed in the associated JTI. The Data Correlation 
Sheet itself breaks down into a number of columns for each 
task listed thereon. See Figure l. 

The first column indicated the task number assigned 
to the specific task in the JTI. The letter in this alpha- 
numeric group Signifies that the task is a member of one 
of the following groups: 

A - Administrative Tasks 


Shore Tasks 


Sea Tasks 


B 
Ec 
De lratize Handling — Circuit Operations Tasks 
E 


Automated Systems Tasks 


To 
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mines task” column contains) the title of the task. The 
Navy Occupational Task Analysis Program (NOTAP) number follows 
poe contains no significance for this thesis. 

The next three columns are composed of the percentages 
within rate groups who perform the given task as determined 
by the NOTAP surveys. 

Following these percentage columns iS the "Existing 
Skill Level" column which indicates the minimum rate required 
to perform the task. The code ranges from 2 to 9 and stands 
for E-2 to E-9. 

The task criteria ratings described earlier constitute 
the entries for the next seven columns. 

The "Suggested Skill Level'' consists of the recommended 
rate as judged by the SMEs. In most cases, the figures in 
this column were found to be identical to those in the 
"Existing Skill Levels" column. 

The final two columns, "Recommended Instructional 


Setting" and "Remarks" were left blank on all sheets. 
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METHOD 


Approach 


To analyze the task selection process, the actual out- 
put of the Radioman Class A School instructional systems 
development process in the form of finished Data Correlation 
Sheets was used. The ratings on the selection criteria were 
analyzed to determine the degree to which they predicted the 
training decision for each task. 

Of the nearly 600 individual tasks evaluated for all 
radioman skill levels, this study considered 125. Using the 
Job Task Inventory (JTI) as a reference indicating which 
tasks were currently being taught in the Class A School 
and the Data Correlation Sheets as a guide to their desig- 
nated skill levels the author was able to restrict the field 
of tasks to be investigated (CO, NETSCPAC, 1979). Among 
those tasks that were examined were all the tasks specified 
as E-2 skill-level tasks, those currently taught at the 
Radioman Class A School as well as those not taught. Addi- 
tionally, those tasks assigned a higher existing skill level 
than E-2 and which were also taught at the school were also 
included in the analysis. Tasks which required a minimum 
Skill level above E-2 and weren't taught at the school were 
not used, under the assumption that such skills were irrel- 
evant to a school primarily concerned with vestibule training. 

The dependent variables then consisted of three groups 


or categories: 


ee 





1. Tasks at the E-2 skill level which were not taught. 
2. Tasks at the E-2 skill level which were taught. 
3. Tasks above the E-2 skill level which were taught. 
The independent variables manipulated were the task 
criteria rated by the SMEs as well as the percentage of 
E-2s to E-4s in the Radioman rating that perform the task 
as taken from the associated NOTAP survey. The independent 
variables used were: 
1. Percentage of E-2 to E-4 Performing Task 
Probable Consequence of Inadequate Performance 
Delay Tolerance 


Bearnine Olt fLTeulty 


ao FPF Ww hd 


Probability of Deficient Performance 
Time Between Job Entry and Task Performance 
Decay Rate 


Complexity 


Oo oOo NN OD 


Frequency of Performance 


Maalytic Procedure 


Various statistical methods available in the 
Statistical Package for the Social Sciences (SPSS) were used 
for analysis. The programs and data were run using batch 
processing on the IBM 360 series computer located at the 
Naval Postgraduate School. The source of the tables in the 
next chapter is the computer output from these programs. 

Discriminant analysis was performed to see if the tasks 


belonging to one of the three dependent variable groups could 
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be statistically distinguished from those belonging to the 
others and which variables influenced this discrimination 
the most. This analysis was also done to determine how well 
tasks could be classified correctly as to their group member- 
ships. 

Correlation analysis was conducted for the purposes of 
noting significant relationships among the variables. 

Factor analysis was done to try to consolidate the in- 
dependent variables into a smaller list of criteria which 
form distinct attributes. 

All tasks, with their factor scores from the factor 
analysis, were entered back into a discriminant analysis. 
The results of this analysis were then compared with the 


oerainal discriminant analysis. 


Bertprton of the Analytic Techniques Used 
Discriminant Analysis 


The mathematical objective of discriminant analysis is 
to weight and linearly combine the discriminating variables 
in some manner so that the groups are forced to be as 
Statistically distinct as possible, Discriminant analysis 
provides a classification aspect whereby one may insert a 
case with unknown membership and receive an asSignment for 
that case into a group based upon a derived set of classi- 
fication functions. It also uses several statistical tests 
for measuring the success with which the discriminating 


variables actually discriminate when combined into the 
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Seoecriminant functions. Variables which contribute the 
most to differentiation along the respective functions are 
Mmeentified (Klecka, 1975). 

Correlation Analysis 

It is often desirable to observe and measure the assoc- 
iation which occurs between two or more statistical series. 
The association between series may be established and 
measured by means of regression analysis. Pearson correlation 
is one of the variations of regression analysis used to dis- 
cern variable relationships. It yields the correlation co- 
efficient value of variable pairs as well as their statistical 
Significance (Arkin & Colton, 1960). 

Hacevor Analysis 

Factor analysis is employed to combine many variables 
into smaller groups from which to make statistical inferences 
or to apply further analytical techniques. Factor analysis 
may be useful in any of a number of ways. It was applied 
to this thesis in the following ways: 

1. Data Reduction --— Consolidation of many variables 
into a few, easily handled variables. 

2. Data Transformation -- Translation of results into 
factor scores to be further processed through 
discriminant analysis. 

3. Exploratory Uses -- To uncover unsuspected relation- 
ships which may seem startling at first glance, but 


are actually common sense (Rummel, 1970). 
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RESULTS 


Descriptive Statistics 

To present an overview of the individual selection 
criterion ratings, Table 1 presents the means and standard 
deviations of each task selection criterion by criterion 
Beenpeand also.asS a total figure for all the categories com- 
bined. The "Percentage of E-2s to E-4s Performing" variable 
used a scale ranging from 1 to 100, while the rest employed 
scales from 1 to 9. 

Group 1 is comprised of all those tasks requiring a 
minimum skill level of E-2 for proper performance which 
were not being taught in the course at Radioman Class A 
School. Classification of this group and the others was 
based upon the 1979 Job Task Inventory for general radioman 
tasks and the Data Correlation Sheets. Group 2 consists 
of the remaining E-2 tasks, all of which were being taught 
in the school. Group 3 contains all the other tasks that 
were being taught and which were determined to have a mini- 


mum existing skill level higher than E-2. 


Peeatection and Policy Capturing 


Discriminant analysis was performed using the Wilks' 
stepwise method. The use of a stepwise procedure produces 
an optimal set of variables being selected, It is an efficient 
means of approximately locating the best set of discriminating 
variables. The Wilkst lambda is a measure of group discrim- 


ination (Nie, Hull, Jenkins, Steinbrenner, & Brent, 1975). 
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Table 1 
Means and Standard Deviations of Criterion Groups 


on the Task Selection Criteria 


Task Criterion CuEOUpEe eo rOUpee “Group 3 Total 
Percentage of E-2 to 50nd 3S Se .00 40.26 so oO 
E-4 Performing etd, 29.54 36.45 Sieh 
Probable Consequence of 2.56 2.206 Sar lcd, 22.6 2 
Inadequate Performance LO” ie Ol Wee Oe 
Delay 2.88 2.96 Da 2.88 
Tolerance .96 1.14 aod: i uk 
Learning Zee 2.49 220 2.48 
Perriculty mort . 80 Poul . 86 
Probability of Deficient 2205 2462 2.60 Pwo 
Performance nOZ 99 Vee . 89 
Time Between Job Entry 4.93 4.96 3.94 4.66 
and Task Performance .26 20 1.00 aiZ 
Decay eS 1.43 1.40 1.38 
Rate sO 1 . 80 a) ©) . 66 
Complexity lio 1.66 2.00 Lazo 
. 86 94 97 no 
Frequency of 4.42 4.91 4.66 4.67 
Performance Se aS .48 LOZ 
Note 1: In each pair of figures the mean is on top and the 


standard deviation is below, 


Note 2: The groups are coded as follows: 


Group 1 -- Tasks at the E-2 skill level which were 
nO aug. 

Group 2 -- Tasks at the E-2 skill level which were 
taught. 


Group 3 -- Tasks above the E-2 skill level which 
were taught. 
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Two functions were derived from the discriminant 
analysis. Table 2a displays the standardized discriminant 
function coefficients. Ignoring the sign, each coefficient 
indicates the relative contribution of its associated variable 
to the particular function Since they are measured on the 
same scales. The sign just signifies whether the variable 
makes a poSitive or negative contribution. The coefficients 
capture the policy used by the ISD personnel in weighting 
the task selection criterion variables. 

The next table, Table 2b, provides additional information 
for evaluating the effectiveness of the two derived functions. 
The eigenvalue is a measure of the relative importance of the 
function. The sum of the eigenvalues is a measure of the 
total variance existing in the discriminating variables. The 
percentage of variance yields an easy reference to the 
relative importance of the associated function. The canonical 
correlation is another measure of the function's ability to 
discriminate among the groups. Wilks lambda is an inverse 
measure of the discriminating power in the original variables 
which has not yet been removed by the discriminant functions -- 
the larger lambda is the less information remains. The 
Significance of the chi-square values indicates that the 
functions predict the dependent variable considerably better 
than chance (Nie, et al., 1975). 

Classification of the cases applying the discriminant 


functions is depicted in Table 2c. This tatle shows the 
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Table 2 


Discriminant Analysis of the Task Selection Criteria 


oes Standardized Canonical Discriminant Function Coefficients 


Independent Variable 


Probable Consequence of 
Inadequate Performance 


Delay 
Tolerance 


Probability of Deficient 


Performance 


Time Between Job Entry 
and Task Performance 


Complexity 


Frequency of 
Performance 


Funetion i 


—= 
e 


Funetion 2 


oO Cron 
297 -.010 
316 -.058 
Sol -.014 
oie .442 
. 248 .949 


b. Statistics Related to the Discriminant Functions 


Seavistic 


Eigenvalue 

Percent of Variance 
Cumulative Percent 
Somonical Correlation 


Wilks' Lambda 
Chi-Square 

Degrees of Freedom 
Significance 





Function 1 


82. 
82. 


Function 2 


oe dt 
49 17.99 
49 LOO. 00 
-O¢ oS 


After 


Zo 


20) 
12 


Punetrone Oo Atter Function 1 


47 .89 

i IS) 08: 
D 

000 .002 








Cz Dbascriminant Classification of Tasks Versus Actual Task 
Group Membership 


wemiat Group *£ of Cases Predicted Group Membership 


Gis oem Group 2 Group 3 


Group l 43 19 24 0 
44.2% 55.8% 0.0% 

Croup 2 47 eu oo) 1 
23.4% 74.5% 2.1% 

GEoup 3 30 2 8 Zo 
5.7% 22n 95 71.4% 


Note 1. For a breakdown of Groups 1, 2, & 3, see Table l. 


Note 2. Percent of ''grouped'' cases correctly classified: 63.2%. 
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number of cases (tasks) which belong to each group and the 
number and the percentage of cases correctly and incorrectly 
placed. The overall percentage of correct placements was 
63.2, whereas the expected (random) placement was 33.3 
percent. Thus, the calculated placement is 200 percent 


better than chance. 


Peewor Analysis and Factor Commun mon ets QeoeheeCelomecriteria 


Factor analysis was used to determine what underlying 
factors or principles were used in determining which tasks 
would be taught. The purpose of the analysis was to develop 
a set of fewer selection criteria that, being more distinct 
(less overlap), might prove to be more effective and/or more 
eweerevent in the classification of job tasks for training. 

Table 3 presents the Pearson correlation matrix showing 
the first-order relationship among the variables that form 
the basis for the factor analysis. It is conventional to 
regard a probability of 0.05 as the critical level of sig- 
nificance (Tippett, 1952). The significance was calculated 
for each criterion pair on the basis of all 125 cases except 
for those pairs involving the "Percentage of E-2s to E-4s 
Performing" due to missing values for that variable in 20 
Sa, the cases. 

The method of principal factoring (without interation 
and with varimax rotation) was used to extract the factors. 
Table 4a presents the weights and variance accounted for 


by the nine factors calculated. Clearly the first three 


oak 
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Table 4 
Factor Analysis 


a. Factor Weights 


Factor Kigenvalue % of variance Cumulative % 
1 3.00 33.4 33.4 
2 £53 7.0 20.4 
3 1.26 14.0 64.4 
4 .93 TORS 74.7 
3 .¢4 S23 S3.0 
6 OO One 89.2 
a .48 Oise 94.5 
8 2S oa 97.6 
9 noe 2.4 LOO; 0 


b. Varimax Rotated Factor Matrix 


Independent Dit ticul ty Immediacy Consequences 
variables? (Factor 1) GHactor 2) (Factor 3) 
E24 -.069 .778 -.002 
INADPERF eo .2o9 . 794 
DELAYTOL wee eS .094 
LEARNDIF . 786 -1S6 leo 
DEFPERF .696 .O81 eoliey al) 
TIME -.079 . 164 -.783 
DECAYRT .900 - .083 -.073 
CMPLXTY . 869 -.097 alae 
FREQ ~.129 . 389 -.353 


*For full variable names see Table Se nove 4, 
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factors possess the most influence, comprising nearly two- 
thirds of the total variance. The program retained and 
printed only components with eigenvalues greater than or 
equal to 1.0, hence, only the first three factors were con- 
Sidered by the program for the remainder of its analysis 
mom, 1975). 

Table 4b portrays the coefficients of each criterion 
as they lie in each of the three factors. For Factor l, 
the criteria of decay rate, complexity, learning difficulty, 
and probability of deficient performance carried the most 
weight and, in combination, seemed to indicate a difficulty 
factor. Hence, Factor 1 was entitled "Difficulty." Factor 
2 is dominated by delay tolerance and the percentage of E-2s 
to E-4s performing the task. This seemed to indicate a 
feeling of immediacy. Thus, ‘Immediacy'' was the name given 
to that factor. Probable consequence of inadequate perfor- 
mance and time between job entry and task performance were 
the strongest coefficients in Factor 3. "Consequences" was 
the word deemed most descriptive of Factor 3. Varimax 
rotation has the effect of clustering variables. The 
overall outcome is a reduction in the number of inputs to 
be analyzed further. 

The cases were individually factor scored using the 
three factors. Then, the factors were injected into a 
discriminant analysis using the factor scores for each 


task. 
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Table 5a shows that the immediacy factor and the con- 
sequences factor were the most discriminating of the three. 
Function coefficients were assigned accordingly. 

Table Sb indicates that Function 1 is overwhelmingly 
Superior in discrimination to Function 2 through the extreme 
difference between eigenvalues. Note that the percentage 
of variance of the first function is nearly one hundred 
percent. There is a correspondingly large difference between 
the canonical correlations. Notice also that there is an 
extremely high level of significance for the first function, 
but the second functionis not significant. 

Table 5c displays correctly and incorrectly predicted 
memberships of groups based on discrimination due to factor 
analysis. Note that the overall percent of "grouped" cases 
classified correctly is 1.2% less than that of the task 
criteria discrimination shown in Table 2c. However, from 
the standpoint of efficiency, the classification is being 
accomplished with essentially one function that has only 
two component variables (Factors 2 and 3). 

Figures 2 and 3 graphically depict the discrimination 
based on task criteria and factor scores for their respec- 
tive functions. Notice how Function 1 in Figure 2 clearly 
discriminates the tasks with existing skill levels higher 
than E-2 from all tasks on the E-2 level. Function 2 of 
the same figure clearly segregates both groups of E-2 


skill level tasks from each other. In Figure 3, one may 
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Table 5 
Discriminant Analysis of the Factor Analysis Results 


a. otandardized Canonical Discriminant Function Coefficients 
of the Factor Scored Tasks 


Factor Function 1 Fine Glan 2 
Immediacy (Factor 2) ae oal 929 
Consequences (Factor 3) 971 ee 


Db. Statistics Related to the Discriminant Functions of the 
Factor Scored Tasks 


Beacastic Mime t tenet Funct ron: 2 
Eigenvalue Oe .OOL 
Percent of Variance 99.82 ee 
Cumulative Percent 99.82 100.00 
Canonical Correlation .o9 03 


After Function O After Function 1 


Wilks Lambda "69 .99 

Chi-Squared 91.99 5 LA 

Degrees of Freedom 4 d 

Significance OOO £130 
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ee Discriminant Classification of Factor Scored Tasks Versus 
Actual Task Group Membership 


Actual Group # of Cases Predicted Group Membership 
Group l CeOup 2 GueUp oO 
Greup | 43 20 16 7 
46.5% 3/226 16.3% 
cGeup 2 47 14 S2 1 
29.8% 68.1% a eiic 
faelp 3 oo 2 8 25 
Din (0 22.9% 71.4% 


Note 1. For Breakdown of Groups 1, 2, & 3, see Table l. 


Note 2. Percent of "grouped'' cases correctly classified: 
ali Gro. 
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Figure 2. 


Figure 3. 


Fune tron 






i ) 2 


Puneciion. 


: Group 3 
(1.42, -.04) 
Group 1 -1 
(-.62, -.49) Vv 


Seaererolor oreecanoniecal diseriminant functions 
of tasks evaluated at group means. 


Pume dome 





ms Group 3 
Group 2 GOS 02) 
(=269 5.03) ! 
| 
-2 = ! 1 9 
| Function 1 
Group - : 


Scatterplot of canonical discriminant functions 
of factor scored tasks evaluated at group means. 
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readily discern a negligible amount of effect among the 
meeps by Function 2, while Function 1 exhibits a fair 


degree of separation among the groups. 


og 





DISCUSSION 


Overview 

It appears as though the ISD process isS successful in 
the selection of important tasks for training at Radioman 
Class A School. The criteria of probable consequence of 
inadequate performance, delay tolerance, time between job 
entry and task performance, complexity, and frequency of 
performance seem to influence the selection decisions more 
strongly than the others. However, some criteria used 
in the selection process detract from the potential efficiency 
of the process. Their contribution is negligible in most 
instances. There are ways to increase efficiency through 
better utilization of the more discriminating criteria. 

The results suggest that there exists a clear discrimi- 
meeron between all E-2 tasks and those tasks of a higher 
Skill level. However, an unclear picture remains of the 
discrimination between the E-2 skill level tasks which are 
selected for Radioman Class A School training and those that 
are not. The decision for not selecting a task for training 
is apparently based upon other criteria such as facilities 
available, institutional resources available -- both budgetary 
and personnel, etc. 

The analyses raised doubt about whether certain tasks 
were rated higher following a conscious decision that they 
needed to be trained or if the selection of the tasks occurred 


because certain tasks had higher ratings from an objective 
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rating process. One is unable to ascertain the truth from 


Seatie data. 


Maeeetation of Analytical Findings 


Examination of the group means of the criteria reveals 
that in the majority of instances Group 3 tasks (the higher 
skilled, taught tasks) are easily distinguishable from the 
tasks in the E-2 skill level groups by a significant degree. 
This is readily apparent in the criteria of probable conse- 
quence of inadequate performance, delay tolerance, learning 
difficulty, time between job entry and task performance, and 
Semeeexity. By contrast, only a few criteria separate Group 
2 tasks from the rest, and fewer still separate Group l 
tasks. 

Insight may be gained from contrasting pairs of task 
groups using the criteria means. Probable consequences of 
inadequate performance exhibits a large difference between 
Group 2 and Group 3 skills. The same holds for delay tolerance 
and time between job entry and task performance, although for 
the latter, the more important result is that Group 3 is 
discriminated from the combination of Groups 1 and 2 which 
are nearly equal in value. Learning difficulty displays its 
greatest separation on Group 3 from Group 1. Decay rate is 
unique in that it is the only criterion which seems to pull 
Group 1 out from the others with its low mean. This makes 
sense because it is better to formally train those tasks 


which are more easily retained for later use than train the 
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tasks which will only require retraining at the job site due 
to Knowledge loss. Decay rate and frequency are the only 
fomwemert LeCria which markedly contrast Group 1 with Group 2. 
Unfortunately, this decay rate carries little importance in 
either of the discriminant analyses performed. Frequency 
also differentiates Groups 1 and 2. Also, complexity shows 
a consistent difference for each task group. The probability 
of deficient performance criterion is too evenly matched 
across the board to have any important effect in the outcome 
of the selection process. 

For finer analysis of the differences between the 
groups, discriminant and factor analysis were performed. 
The discriminant analysis of the task criteria greatly dis- 
criminates Group 3 from the others. The high positive weight 
asSigned to probable consequence of inadequate performance 
in the first function, when multiplied to the group means, 
boosts the Group 3 value considerably higher than the others. 
Similarly, the weight of complexity raises the value of 
Group 3. The criterion of time between job entry and task 
performance contains a large, negative weight which contributes 
to a negative value added to the overall score for Group 3, 
but to a much lesser extent than the negativity which re- 
sults for both Groups 1 and 2. The second function favors 
discrimination of Group 2 in that the negative weight assigned 
to the probable consequence of inadequate performance criterion 


and the high, positive value associated with frequency of 
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performance contribute significantly to a higher overall 
value for the Group 2 scores. This second function is con- 
Siderably less important than the first function. Thus, 
Overall, this discriminant analysis application is best 
suited for the classification of Group 3 tasks. 

Checking the results of the factor analysis, one sees 
that the discrimination of groups is pretty much the same, 
with Group 3 being delineated the best. The Difficulty factor 
PomeomooSed, in part, of learning difficulty, decay rate, and 
complexity, all of which have high positive weightings which 
places the value of the Group 3 factor scores well above the 
other two. These three criteria are the most important in 
Giemeittiiculty factor. In combination with each other, it 
would seem that these criteria should be excellent in dis- 
criminant analysis. The Immediacy factor favors the discrimi- 
nation of Group 2 among the others. The high positive 
weighting of delay tolerance along with the moderately high 
positive weighting of frequency of performance, boosts the 
resultant value of Group 2's factor scores higher than those 
of the other groups. Yet, this factor, too, is relatively 
insignificant in the discrimination analysis that was per- 
formed. In the Consequences factor, the high positive weight 
for probable consequence of inadequate performance together 
with the high negative weight for time between job entry and 
task performance plays an important part in yielding a high 


value to the Group 3 factor scores. The moderately high 
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negative weight given to the frequency of performance cri- 
terion enables the Group 1] factor scores to be somewhat 
higher than Group 2 equations, but not as high as those for 
mews. A quick glance at the Function 1 axis in Figure 
3 illustrates the point. The Consequences factor is the 
Single most important discriminating rector —A2Ccoralng £O 
eaemarscriminant analysis. 

The discriminant analysis of the factor scores assigns 
a high positive weight to the Consequences factor and a 
moderately high negative weight to the Immediacy factor. 
This has the effect of maintaining the high amount of Group 
3 discrimination in the Consequences factor while something 
interesting happens within the Immediacy factor. Heretofore, 
the Immediacy factor was a good discriminator of the Group 
2 tasks. With a moderately high negative weight multiplied 
to the Immediacy factor scores, the dominant criteria of 
delay tolerance and frequency of performance switch from 
yielding a positive-type influence to yielding a negative- 
type influence. In reviewing the means, one sees that a 
negative weight for the delay tolerance criterion yields 
a result with Group 3 having the higher overall value, anda 
negative value to frequency of performance gives a higher 
value to the Group 1 tasks. Thus, the effect of Function l 
in the discrimination analysis of the factor scores is to 
favorably increase the discrimination of Group 3 through 


the combination of the consequences and immediacy factors, 
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as well as to slightly enhance the discrimination of Group 1 
tasks. Again, Figure 3 bears this out in placement of group 
centroids along the x-axis (Function 1). Group 3 is given 

a high positive value, while Group 1, though slightly nega- 
tive, is still higher than Group 2 scores. In the same 
maeeysis, Function 2 credits both factors (Immediacy and 
Consequences) with positive weights, the emphasis being on 
Miem=emmnediacy factor. But, this function is of little 
Significance whatsoever in the discrimination abilities of 


either function. 


Alternative Measures 

The selection of tasks for training at Radioman Class 
A School involved review of several different criteria 
which were carefully rated. However, it appears as though 
selection may be done just as well from the use of only a 
few of the criteria based on the analyses performed for 
this thesis. The factor-scored discriminant analysis uses 
one function, involving primarily the Consequences factor, 
Memetiect a classification with an overall accuracy of 
61.6%. The percentage of correct classification of both 
groups of tasks which are taught is even higher than the 
overall classification accuracy. Two selection criteria 
are dominant in the consequences factor; namely, probable 
consequence of inadequate performance and time between job 
entry and task performance. Of secondary importance is 


frequency of performance. In a recent conversation with the 
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menor, Mr. Richard Lund (1980) of Instructional Program 
Development Department (IPDD), San Diego, stated that although 
IPDD did not perform a statistical analysis of the criteria 
for the selection process, the most influential criteria for 
task selection were probable consequences of inadequate 
performance, the time criterion, frequency, and decay rate. 

It is interesting, indeed striking, that the first three 
criteria mentioned are greatly influential in the Consequences 
factor. It seems that use of the Consequences factor would 
increase the efficiency of the criteria rating by reducing 

the number of independent variables. Prediction can be made 
just as well with fewer criteria as it is with the full set 
@ieeriteria. Thus, a small number of criteria has the ability 
to do all the work of several. 

Another approach which merits investigation is the idea 
of scaling the criteria differently. One possibility is to 
create a weighted checklist of statements reflecting the full 
range of attitudes toward each criterion. Each statement 
would describe one attitude toward the particular criterion. 

A panel of judges would classify the statements in categories 
ranging from those they consider to be extremely favorable 

to those they consider to be extremely detrimental (McCormick 
& Tiffin, 1974). This classification could be accomplished 
using the paired comparison technique in which each state- 
ment is compared to each other until each is in the most 


appropriate location in the spectrum. Weights would then be 
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assigned relative to the final positions of these statements. 
Checklists of each criterion for each task would then be 
distributed to the SMEs. Each SME could indicate which 
statements most accurately depict the criterion for a given 
task by placing a check mark next to the appropriate state- 
ment. The weights of the statements would be unknown to 

the SMEs. Upon receipt of the completed checklists from 
each SME, the selection board would tally the weighted 
checks and determine the overall rating of each task for 

a training decision. This type of Thurstone scale has been 
widely used in many psychological tests and for applications 
relating to discrimination of judgment (Bock & Jones, 1968). 
To carry this technique one step further, the SMEs, instead 
of simply marking the appropriate statements, could rank the 
statements using the paired comparison technique. These 
rankings, in conjunction with the previously determined 
weights could further refine the overall ratings of the 


tasks for the training decision. 


Limitations 

This analysis focused on a specific application of the 
ISD process. For a broader generalization with respect to 
the ISD process of task selection, this analysis should be 
cross-validated with other schools, e.g., other Class A 
Schools and advanced Radioman schools. One problem that 
may occur is that different sets of SMEs may alter the 
reliability of the results resulting in shrinkage of the 


predictions. 
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This analysis concentrated purely on task selection. 
Use of the JTI and application of the ISD process appears to 
be fairly good in determining which tasks get trained, but 
this does not mean that the selection is optimum for the 
requirements of the Navy. Supervisors and managers in the 
operational environment perceive training in relation to 
the end product. 

In the task-selection process consideration must be 
made of how the graduate is able to function in his assign- 
ment after graduation. The selection process, analyzed by 
this thesis, utilized the results of a NOTAP survey in 
determining the percentages of apprentices performing various 
tasks. Further follow-up and surveys of initial assignments 
Should be conducted. These surveys should be performed at 
eiemslces representative of andin proportion to the types of 
fee tO Which the graduate is sent. The unique needs of 
the fleet should be noted in the survey for use as feedback 
into the ISD task ee eion process. 

Under "ideal" conditions, 40% of Radioman Class A 
School graduates report to shore stations while the re- 
maining 60% report for sea duty. In a compilation of sea 
duty assignments, by RM1 Randall of Radioman Class A School, 
for the period of July 1979 through December 1979, the 


following list was constructed: 
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Ship Type Pemceneacesassi ened 


Dia ee CoMoatates =.= = . 30.96 
Bio Dabo us Shs) a oe ea. O oS 
APeeqe tt Carriers, Sheer. se ve, lO, O4 
SSE VOLO / Nip cal ea fees eX = ine es Ie, 
farce Compatarus, et = « «= s [0.02 
SUS Maines ee i 2) ae metss, fC) ald 
VISE ReN) akties i aens an eee © ool Pie: 


This breakdown in assignments could be used for determining 
which tasks deserve increased attention (1i.e., which tasks 
are more applicable to a higher percentage of the assign- 


ments) as well as for future survey applications. 
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CONCLUSIONS AND RECOMMENDATIONS 


The results determined by the analytical methods of 
this thesis were based on an exceptionally good data base. 
The Data Correlation Sheets used were the same ones used by 
the actual task selection board for the Radioman Class A 
School course. The ratings assigned to each criterion for 
every task were done so by subject matter experts intimately 
familiar with all aspects of the tasks. These subject 
matter experts were actual Navy radiomen representing a 
broad base of experience. 

Based on the research conducted it is concluded that: 

1. Prior to this study, it was unclear whether 
criteria ratings are being used in a systematic way. It 
was not clear whether the SMES were able to purposely rate 
certain tasks higher to increase the probability of selection 
for training, or whether the actual tasks selected for training 
were the result of having a higher rating from an objective 
process. This thesis has demonstrated that criteria ratings 
may be used systematically. 

2. It appears that there are more efficient/effective 
ways of evaluating tasks than are currently being used. One 
possibility suggested is the development and application of 
a Thurstone scale to criteria rating. This type of scale 
yields a better insight as to the exact perception the SME 
has of the tasks than the current scales reveal. Should 


this scale be used, more efficiency may be reaped by limiting 
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fmiewcr?teria to those discovered in the results of this 
research which carry the most influence. 

3. The criteria used, in and of themselves, do not 
reveal a substantial discrimination of the E-2 skill level 
tasks which are trained from the E-2 skill level tasks which 
are not trained. There are apparently other factors outside 
the criteria judged which play a part in making this deter- 
Mewat lon. 

4. Results of this thesis are not necessarily 
generalizable to other types of schools, be they Class A 
schools or other Radioman-related schools. The utilization 
of the criteria ratings in the same fashion may not be 
appropriate for other schools, nor is it Known whether the 
criteria rating scales should be the same for all. 

Oo. There may be simpler ways of combining criteria 
to analyze tasks. For the specific case of task selection 
for Radioman Class A School, the several individual criteria 
can be consolidated into one factor which works about as 
Pewee tn Classification of tasks which should be trained. 

The factor concerned is the Consequences factor which is 
dominated by the criteria of probable consequence of in- 
adequate performance and time between job entry and task 
performance, with frequency of performance acting as a 
secondary source of influence. With its adequate prediction 
capability, the consequence factor may be used in task 


selection, thus saving a great deal of time and resources. 
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Based on these conclusions, it is recommended that: 

1. Similar procedures as employed in this thesis 
should be used to evaluate task selection for the "classic" 
A school course. The results of such analyses may prove 
quite beneficial in terms of reducing overall ISD costs. 

2. Development of a different criterion scaling 
procedure that would be simpler and more effective should be 
considered. The Navy might be better off in its training 
selection decisions if a Thurstone scale were used for 


measuring the tasks in lieu of the current rating process. 
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APPENDIX A 
Criteria Ratings of Tasks Analyzed 


from the Data Correlation Sheets 





Task Group Criteria * 


eco oO aso) Oo 


Distribute instructions ieerlamezececec eo 11 4 
Distribute notices lie ae 2 eo, 1 4 
Distribute directives ian PAN oe. 1.1 4 
Participate in field days, sweepdowns, 

and similar activities ois oleae oO elt 5 
Participate in working parties ISO owe 2 Ode 2 Oo 


Participate in inspections 
(zone, personnel, safety) SoG ome Ge5eis 2.4 


Participate in communications 
emergency drills (power failure, 


casualty ) Mees eo 4 ie, So 
Participate in communication 

exercises/drills lpr ono, o. 47442 3°.2 
Participate in general drills leo oe oroaS 3S 5 1 25 
Update broadcast files ec Oomon Ocoee el, 1 5 
Update general message files eel mae oOo lO 
Update world-wide task 

organization guide [lomom os 2.000 2 1 5 
Update communications 

tmastruction file ieee 2.5 5 1 1 4 


*A key for the group entries and the criteria is provided 
at the end of this appendix, 
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Task 


Update communications notices 
file 


Update communication directives 
file 


Update crypto center files 


Update communication center 
message files 


Update fax files 
Update message tape file 


Make log entries in general 
message log 


Make log entries in the broad- 
cast checkoff log 


Make log entries in the 
Morse telegraphy (CW) log 


Make entries in the visual log 


Make entries in the radio- 
telephone log 


Make entries in the order-wire 
teletypewriter log 


Make entries in the TTY 
ship/shore log 


Receive secret material 
Control secret material 
Mark/remark secret material 
Receive confidential material 


Control confidential material 


o4 


Group 

i 
1 24 
1 24 
t 24 
WE 
1 24 
1 24 
2 oO 
2a 
iO 
1 350 
a0 
bari ©) 
2 934 
eS 
3 28 
3 ae 
SeaS 
So 





Task 


Mark/remark confidential material 


Control classified working papers 
(rough drafts, etc.) 


Control classified msc. materials 
(ribbons, etc.) 


Identify & correct inadequate 
safety precautions 


Cut tapes on the UGC-6 teletype 
Transmit msgs on the UGC-6 teletype 
Receive msgs on the UGC-6 teletype 


Perform operator's maintenance 
on the UGC-6 teletype 


Patch with the SB-988/SRT 
transmitter transfer switchboard 


Perform preventive maintenance 
on the SB-988/SRT 


Receive msg traffic on the 
AN/FGC-100 TTY terminal equipment 


Perform operator's maintenance 
on the AN/FGC-100 


Pass (send) message traffic 
on the TT-333 


Perform operator's maintenance 
on the TT-333 


Perform operator's maintenance 
on the TSEC/KW 26 


Send (transmit) msg on the 
TT-333/UG (dist. trans set) 


OO 


Group 

it 
Saco 
See 
3 28 
29 eae 
2a oe 
Coe 
Zoe 
1 56 
2 06 
ee OG 
2 04 
1 04 
2 04 
1 04 
1 08 
3 04 


Oo WO WW 


Do Oo W Ww 


Criteria 


ooo. 








Task 


Monitor the AN/FGC-79A (FLT BCST 
(R)) FLT SATCOM 


Receive msg on the AN/FGC-79 TTY 
(FLT center termination) 


Receive msg and tape on the 
TT-331 A/UG reperforator 


set up the November System 
(multi-channel receive) 


secure the November System 
(multi-channel receive) 


set up the Charlie System 
(UHF covered duplex) 


Secure the Charlie System 
(UHF covered duplex) 


Set up Romeo System (covered voice) 
Secure Romeo System (covered voice) 


Set up Uniform System (uncovered 
voice) 


Secure Uniform System (uncovered 
voice) 


Set up Golf System (HF covered 
duplex) 


Secure Golf System (HF covered 
duplex) 


Select channel on the AN/SRA-12 
(elect filter assembly) 


Connect/disconnect the MF-HF 


antenna (AS-25430) to the 
AN/SRA-12 


o6 


Group 

1 
3 Oo 
Sa OO 
SOS 
See 
ae 
oe sled 
oa = 
olen 
OP orca 
oe 
See 
See, 
Sess 
2 14 
1 34 


Co 


Criteria 


Oe oo 





Task 


Connect/disconnect the MF-HF 
receiver (R1051) to the 
AN/SRA-12 


Patch/unpatch the SB 973 receiver 
transfer switchboard 


Patch/unpatch the SB-1203A/UG 
communication patching panel 


Perform preventive maintenance 
on the SB-1203A/UG 


Patch/unpatch the SB-1210A/UGO 
communication patching panel 


Perform preventive maintenance 
on the SB-1210A/UGO 


Energize the PP-3495/UG 
power supply 


Deenergize the PP-3495/UG 
power supply 


Patch/unpatch the SB-988/SRT 
transmitter transfer switchboard 


Patch/unpatch the SB-863 trans- 
mitter/transfer switchboard 


Adjust the AN/URA-17 
(comparator-converter group) 


Tune the AN/SRA-13 (coupler group 
antenna ) 


Energize the AN/UCC-1 telegraph 
terminal 


Deenergize the AN/UCC-1 telegraph 
terminal 


ov 


Group 

1 
2S 
NS) 
Zee 
a cS 
Zoo 
reco 
ae 
awe 
2 Oo 
2 14 
2 24 
1 04 
Zo lee 
Zoe 


Criteria 


Som tec. 








Task 





Start the CV-2460/SGC telegraph- 
telephone signal converter 


Set up the CV-2460/SGC telegraph- 
telephone signal converter 


Receive messages on the AN/UGC-25 
teletype 


Operate the AN/SRA 33 (antenna 
Ceupler group) 


Adjust volume on the AM-3729/SR 
(speaker amplifier) 


Patch/unpatch the C-7594 (remote 
Ewitching control) 


set up the AN/URT-23(V) radio 
transmitter set 


Tune the AN/URT-23(V) radio 
transmitter set 


Check and adjust the TSEC/KWR-37 
werypco unit) 


Perform start sequence on the 
TSEC/KWR-37 


Establish cipher communications 
on the TSEC/KW-7 (crypto unit) 


Record message transmission in the 
outgoing circuit log 


Record time of delivery on the 
transmitted message 


Record message reception in the 
mecoming circuit log 


Record time of receipt on the 
received message 


08 


2 


Group Criteria 


t23:45678 9 


OOS hog fo 1: 1 4 


OOo come O82 6. SO 


Pioeoee ecco 


Oe 2 8) SES) 2 eS, 


OZelieaece eo bel Oo 


OOR7 a Cacn elec oO 


Poe Ono 23 2 


l29e9e 0 22 23 3 


26 423442305 


2642344235 


46-4233 9 2 3 5 


D0mzee 22 0 Fl 5 


Zoe So so 1b iD 


B0mze4>2 390 1 1 5 


Zomemowe o 2 | tl 5S 








Task Group Criteria 


Ieee eo yo 1 8&9 





Record message reception on the 


broadcast checkoff sheet ZeepoOr2 222s... 1 5 
Perform sequence of operation on 

the R1O51 radio receiver Zee Too oa SO 
Perform sequence of operation on 

the SSR-1 (VHF multi-channel ) 3 -- 43222124 
sequence outgoing original msg draft 2-+-- 442251415 


Assign date/time group and SSN to 
outgoing message draft Zeit 2 2 Oe eel 


Screen and review original outgoing 
message draft 2 382444534 5 


Format outgoing msg for entry into 
TTY tape emission media-—-Autodin 1 --14445 34 5 


Format outgoing msg for entry into 
TTY tape emission media--Modified 
126 2<-+-14445 345 


Format outgoing msg for entry into 
TTY tape emission media--ACP 126 2-"+--° 144445 3 4 


Format outgoing msg for! entry into 
voice transmission systems 1 -- 2444059393 4 


Format outgoing msg for delivery 


by CW transmission media 1 -- 44445 3935 
Format outgoing msg for delivery 

by scanner (LDMX) system Zope =e 4S 45 3-3 5D 
Type smooth formated message draft ZO eeeoee Oo os 8 1! 3S 3 


Screen & review smooth copy of out- 
going messages for completeness 
& correctness Semen 22 2°52 9 


Deliver outgoing smooth msg to 
releasing officer for release ieee t 2 25 | 1/5 





Task 


Deliver outgoing message to 
selected circuit for transmission 


Sereen & review outgoing trans- 
mitted msg from circuit operator 


Log outgoing message information 
into central msg log 


Route outgoing msg into action, 
info departments 


Reproduce copies of outgoing msg 
IAW route stamp 


Stamp outgoing message with 
designated classification 


Distribute reproduced copies 
of orig msg 


Omen Outgoing msg prior to filing 
Serattic checker) 


File outgoing messages into comm 
cen files 


Advance route designated incoming 
msgs 


Screen & review incoming messages 


Log incoming msgs into central 
message log 


Reproduce incoming messages 
Distribute incoming messages 


Check incoming messages prior to 
melons (traffic checker) 


File incoming msgs into com 
cen files 


60 


GEO Up 


Bl 
ee 
Sa 
2 54 
Zee 
1 60 
2, 818 
1 40 
3 24 
Zeal 
a 
2 44 
3. 54 
1 60 
1 40 
2 24 
See lil 


i) 


QO 
o1 
ee 
her 
Oi 


to 
on 
4 
4 
oo Oo 








Task Group Criteria 


ec 409 6% 8 9 





Accept message typed on Form 
DD-173 for input to LDMX/ 
NAVCOMPARS a oro oO lel > 


Reject message on Form DD-173 
egeh operator) See — lo pole 2 5 


File service messages 
(service area coordinator) Cee) 6.1.1.5 


Groups 


1. Tasks at the E-2 skill level which were not taught. 
2. Tasks at the E-2 skill level which were taught. 
3. Tasks above the E-2 skill level which were taught. 


Criteria 


1. Percentage of E-2s to E-4s Performing Task. 

2. Probable Consequence of Inadequate Performance. 
3. Delay Tolerance. 

Meeeecarning Difficulty. 

5. Probability of Deficient Performance. 

6. Time Between Job Entry and Task Performance. 

7. Decay Rate. 

8. Complexity. 

9. 


Frequency of Performance. 


onl 
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